Comparing antibody assays as correlates of protection against COVID-19 in the COVE mRNA-1273 vaccine efficacy trial.

The best assay or marker to define mRNA-1273 vaccine-induced antibodies as a correlate of protection (CoP) is unclear. In the COVE trial, participants received two doses of the mRNA-1273 COVID-19 vaccine or placebo. We previously assessed IgG binding antibodies to the spike protein (spike IgG) or receptor binding domain (RBD IgG) and pseudovirus neutralizing antibody 50 or 80% inhibitory dilution titer measured on day 29 or day 57, as correlates of risk (CoRs) and CoPs against symptomatic COVID-19 over 4 months after dose. Here, we assessed a new marker, live virus 50% microneutralization titer (LV-MN50), and compared and combined markers in multivariable analyses. LV-MN50 was an inverse CoR, with a hazard ratio of 0.39 (95% confidence interval, 0.19 to 0.83) at day 29 and 0.51 (95% confidence interval, 0.25 to 1.04) at day 57 per 10-fold increase. In multivariable analyses, pseudovirus neutralization titers and anti-spike binding antibodies performed best as CoRs; combining antibody markers did not improve correlates. Pseudovirus neutralization titer was the strongest independent correlate in a multivariable model. Overall, these results supported pseudovirus neutralizing and binding antibody assays as CoRs and CoPs, with the live virus assay as a weaker correlate in this sample set. Day 29 markers performed as well as day 57 markers as CoPs, which could accelerate immunogenicity and immunobridging studies.

Immune correlates analysis of a phase 3 trial of the AZD1222 (ChAdOx1 nCoV-19) vaccine.

In the phase 3 trial of the AZD1222 (ChAdOx1 nCoV-19) vaccine conducted in the U.S., Chile, and Peru, anti-spike binding IgG concentration (spike IgG) and pseudovirus 50% neutralizing antibody titer (nAb ID50) measured four weeks after two doses were assessed as correlates of risk and protection against PCR-confirmed symptomatic SARS-CoV-2 infection (COVID-19). These analyses of SARS-CoV-2 negative participants were based on case-cohort sampling of vaccine recipients (33 COVID-19 cases by 4 months post dose two, 463 non-cases). The adjusted hazard ratio of COVID-19 was 0.32 (95% CI: 0.14, 0.76) per 10-fold increase in spike IgG concentration and 0.28 (0.10, 0.77) per 10-fold increase in nAb ID50 titer. At nAb ID50 below the limit of detection (< 2.612 IU50/ml), 10, 100, and 270 IU50/ml, vaccine efficacy was -5.8% (-651%, 75.6%), 64.9% (56.4%, 86.9%), 90.0% (55.8%, 97.6%) and 94.2% (69.4%, 99.1%). These findings provide further evidence towards defining an immune marker correlate of protection to help guide regulatory/approval decisions for COVID-19 vaccines.

Correlates of Protection, Thresholds of Protection, and Immunobridging among Persons with SARS-CoV-2 Infection.

Several studies have shown that neutralizing antibody levels correlate with immune protection from COVID-19 and have estimated the relationship between neutralizing antibodies and protection. However, results of these studies vary in terms of estimates of the level of neutralizing antibodies required for protection. By normalizing antibody titers, we found that study results converge on a consistent relationship between antibody levels and protection from COVID-19. This finding can be useful for planning future vaccine use, determining population immunity, and reducing the global effects of the COVID-19 pandemic.

Immune correlates analysis of the PREVENT-19 COVID-19 vaccine efficacy clinical trial.

In the PREVENT-19 phase 3 trial of the NVX-CoV2373 vaccine (NCT04611802), anti-spike binding IgG concentration (spike IgG), anti-RBD binding IgG concentration (RBD IgG), and pseudovirus 50% neutralizing antibody titer (nAb ID50) measured two weeks post-dose two are assessed as correlates of risk and as correlates of protection against COVID-19. Analyses are conducted in the U.S. cohort of baseline SARS-CoV-2 negative per-protocol participants using a case-cohort design that measures the markers from all 12 vaccine recipient breakthrough COVID-19 cases starting 7 days post antibody measurement and from 639 vaccine recipient non-cases. All markers are inversely associated with COVID-19 risk and directly associated with vaccine efficacy. In vaccine recipients with nAb ID50 titers of 50, 100, and 7230 international units (IU50)/ml, vaccine efficacy estimates are 75.7% (49.8%, 93.2%), 81.7% (66.3%, 93.2%), and 96.8% (88.3%, 99.3%). The results support potential cross-vaccine platform applications of these markers for guiding decisions about vaccine approval and use.

Rapidly identifying new coronavirus mutations of potential concern in the Omicron variant using an unsupervised learning strategy.

Extensive mutations in the Omicron spike protein appear to accelerate the transmission of SARS-CoV-2, and rapid infections increase the odds that additional mutants will emerge. To build an investigative framework, we have applied an unsupervised machine learning approach to 4296 Omicron viral genomes collected and deposited to GISAID as of December 14, 2021, and have identified a core haplotype of 28 polymutants (A67V, T95I, G339D, R346K, S371L, S373P, S375F, K417N, N440K, G446S, S477N, T478K, E484A, Q493R, G496S, Q498R, N501Y, Y505H, T547K, D614G, H655Y, N679K, P681H, N764K, K796Y, N856K, Q954H, N69K, L981F) in the spike protein and a separate core haplotype of 17 polymutants in non-spike genes: (K38, A1892) in nsp3, T492 in nsp4, (P132, V247, T280, S284) in 3C-like proteinase, I189 in nsp6, P323 in RNA-dependent RNA polymerase, I42 in Exonuclease, T9 in envelope protein, (D3, Q19, A63) in membrane glycoprotein, and (P13, R203, G204) in nucleocapsid phosphoprotein. Using these core haplotypes as reference, we have identified four newly emerging polymutants (R346, A701, I1081, N1192) in the spike protein (p value = 9.37*10-4, 1.0*10-15, 4.76*10-7 and 1.56*10-4, respectively), and five additional polymutants in non-spike genes (D343G in nucleocapsid phosphoprotein, V1069I in nsp3, V94A in nsp4, F694Y in the RNA-dependent RNA polymerase and L106L/F of ORF3a) that exhibit significant increasing trajectories (all p values < 1.0*10-15). In the absence of relevant clinical data for these newly emerging mutations, it is important to monitor them closely. Two emerging mutations may be of particular concern: the N1192S mutation in spike protein locates in an extremely highly conserved region of all human coronaviruses that is integral to the viral fusion process, and the F694Y mutation in the RNA polymerase may induce conformational changes that could impact remdesivir binding.

A controlled effects approach to assessing immune correlates of protection.

An immune correlate of risk (CoR) is an immunologic biomarker in vaccine recipients associated with an infectious disease clinical endpoint. An immune correlate of protection (CoP) is a CoR that can be used to reliably predict vaccine efficacy (VE) against the clinical endpoint and hence is accepted as a surrogate endpoint that can be used for accelerated approval or guide use of vaccines. In randomized, placebo-controlled trials, CoR analysis is limited by not assessing a causal vaccine effect. To address this limitation, we construct the controlled risk curve of a biomarker, which provides the causal risk of an endpoint if all participants are assigned vaccine and the biomarker is set to different levels. Furthermore, we propose a causal CoP analysis based on controlled effects, where for the important special case that the biomarker is constant in the placebo arm, we study the controlled vaccine efficacy curve that contrasts the controlled risk curve with placebo arm risk. We provide identification conditions and formulae that account for right censoring of the clinical endpoint and two-phase sampling of the biomarker, and consider G-computation estimation and inference under a semiparametric model such as the Cox model. We add modular approaches to sensitivity analysis that quantify robustness of CoP evidence to unmeasured confounding. We provide an application to two phase 3 trials of a dengue vaccine indicating that controlled risk of dengue strongly varies with 50$\%$ neutralizing antibody titer. Our work introduces controlled effects causal mediation analysis to immune CoP evaluation.

Evaluating Vaccine Efficacy Against Severe Acute Respiratory Syndrome Coronavirus 2 Infection.

Although interim results from several large, placebo-controlled, phase 3 trials demonstrated high vaccine efficacy (VE) against symptomatic coronavirus disease 2019 (COVID-19), it is unknown how effective the vaccines are in preventing people from becoming asymptomatically infected and potentially spreading the virus unwittingly. It is more difficult to evaluate VE against severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection than against symptomatic COVID-19 because infection is not observed directly but rather is known to occur between 2 antibody or reverse-transcription polymerase chain reaction (RT-PCR) tests. Additional challenges arise as community transmission changes over time and as participants are vaccinated on different dates because of staggered enrollment of participants or crossover of placebo recipients to the vaccine arm before the end of the study. Here, we provide valid and efficient statistical methods for estimating potentially waning VE against SARS-CoV-2 infection with blood or nasal samples under time-varying community transmission, staggered enrollment, and blinded or unblinded crossover. We demonstrate the usefulness of the proposed methods through numerical studies that mimic the BNT162b2 phase 3 trial and the Prevent COVID U study. In addition, we assess how crossover and the frequency of diagnostic tests affect the precision of VE estimates.

Immune correlates analysis of the mRNA-1273 COVID-19 vaccine efficacy clinical trial.

In the coronavirus efficacy (COVE) phase 3 clinical trial, vaccine recipients were assessed for neutralizing and binding antibodies as correlates of risk for COVID-19 disease and as correlates of protection. These immune markers were measured at the time of second vaccination and 4 weeks later, with values reported in standardized World Health Organization international units. All markers were inversely associated with COVID-19 risk and directly associated with vaccine efficacy. Vaccine recipients with postvaccination 50% neutralization titers 10, 100, and 1000 had estimated vaccine efficacies of 78% (95% confidence interval, 54 to 89%), 91% (87 to 94%), and 96% (94 to 98%), respectively. These results help define immune marker correlates of protection and may guide approval decisions for messenger RNA (mRNA) COVID-19 vaccines and other COVID-19 vaccines.

Tracking SARS-CoV-2 Spike Protein Mutations in the United States (January 2020-March 2021) Using a Statistical Learning Strategy.

The emergence and establishment of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) variants of interest (VOIs) and variants of concern (VOCs) highlight the importance of genomic surveillance. We propose a statistical learning strategy (SLS) for identifying and spatiotemporally tracking potentially relevant Spike protein mutations. We analyzed 167,893 Spike protein sequences from coronavirus disease 2019 (COVID-19) cases in the United States (excluding 21,391 sequences from VOI/VOC strains) deposited at GISAID from 19 January 2020 to 15 March 2021. Alignment against the reference Spike protein sequence led to the identification of viral residue variants (VRVs), i.e., residues harboring a substitution compared to the reference strain. Next, generalized additive models were applied to model VRV temporal dynamics and to identify VRVs with significant and substantial dynamics (false discovery rate q-value < 0.01; maximum VRV proportion >10% on at least one day). Unsupervised learning was then applied to hierarchically organize VRVs by spatiotemporal patterns and identify VRV-haplotypes. Finally, homology modeling was performed to gain insight into the potential impact of VRVs on Spike protein structure. We identified 90 VRVs, 71 of which had not previously been observed in a VOI/VOC, and 35 of which have emerged recently and are durably present. Our analysis identified 17 VRVs ~91 days earlier than their first corresponding VOI/VOC publication. Unsupervised learning revealed eight VRV-haplotypes of four VRVs or more, suggesting two emerging strains (B1.1.222 and B.1.234). Structural modeling supported a potential functional impact of the D1118H and L452R mutations. The SLS approach equally monitors all Spike residues over time, independently of existing phylogenic classifications, and is complementary to existing genomic surveillance methods.

Calibration of two validated SARS-CoV-2 pseudovirus neutralization assays for COVID-19 vaccine evaluation.

Vaccine-induced neutralizing antibodies (nAbs) are key biomarkers considered to be associated with vaccine efficacy. In United States government-sponsored phase 3 efficacy trials of COVID-19 vaccines, nAbs are measured by two different validated pseudovirus-based SARS-CoV-2 neutralization assays, with each trial using one of the two assays. Here we describe and compare the nAb titers obtained in the two assays. We observe that one assay consistently yielded higher nAb titers than the other when both assays were performed on the World Health Organization's anti-SARS-CoV-2 immunoglobulin International Standard, COVID-19 convalescent sera, and mRNA-1273 vaccinee sera. To overcome the challenge this difference in readout poses in comparing/combining data from the two assays, we evaluate three calibration approaches and show that readouts from the two assays can be calibrated to a common scale. These results may aid decision-making based on data from these assays for the evaluation and licensure of new or adapted COVID-19 vaccines.

Evaluating the Long-term Efficacy of Coronavirus Disease 2019 (COVID-19) Vaccines.

Large-scale deployment of safe and durably effective vaccines can curtail the coronavirus disease-2019 (COVID-19) pandemic. However, the high vaccine efficacy (VE) reported by ongoing phase 3 placebo-controlled clinical trials is based on a median follow-up time of only about 2 months, and thus does not pertain to long-term efficacy. To evaluate the duration of protection while allowing trial participants timely access to efficacious vaccine, investigators can sequentially cross participants over from the placebo arm to the vaccine arm. Here, we show how to estimate potentially time-varying placebo-controlled VE in this type of staggered vaccination of participants. In addition, we compare the performance of blinded and unblinded crossover designs in estimating long-term VE.

Evaluating the Efficacy of Coronavirus Disease 2019 Vaccines.

A large number of studies are being conducted to evaluate the efficacy and safety of candidate vaccines against coronavirus disease 2019 (COVID-19). Most phase 3 trials have adopted virologically confirmed symptomatic COVID-19 as the primary efficacy end point, although laboratory-confirmed severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) is also of interest. In addition, it is important to evaluate the effect of vaccination on disease severity. To provide a full picture of vaccine efficacy and make efficient use of available data, we propose using SARS-CoV-2 infection, symptomatic COVID-19, and severe COVID-19 as dual or triple primary end points. We demonstrate the advantages of this strategy through realistic simulation studies. Finally, we show how this approach can provide rigorous interim monitoring of the trials and efficient assessment of the durability of vaccine efficacy.

Mathematical Modeling of Vaccines That Prevent SARS-CoV-2 Transmission.

SARS-CoV-2 vaccine clinical trials assess efficacy against disease (VEDIS), the ability to block symptomatic COVID-19. They only partially discriminate whether VEDIS is mediated by preventing infection completely, which is defined as detection of virus in the airways (VESUSC), or by preventing symptoms despite infection (VESYMP). Vaccine efficacy against transmissibility given infection (VEINF), the decrease in secondary transmissions from infected vaccine recipients, is also not measured. Using mathematical modeling of data from King County Washington, we demonstrate that if the Moderna (mRNA-1273QS) and Pfizer-BioNTech (BNT162b2) vaccines, which demonstrated VEDIS > 90% in clinical trials, mediate VEDIS by VESUSC, then a limited fourth epidemic wave of infections with the highly infectious B.1.1.7 variant would have been predicted in spring 2021 assuming rapid vaccine roll out. If high VEDIS is explained by VESYMP, then high VEINF would have also been necessary to limit the extent of this fourth wave. Vaccines which completely protect against infection or secondary transmission also substantially lower the number of people who must be vaccinated before the herd immunity threshold is reached. The limited extent of the fourth wave suggests that the vaccines have either high VESUSC or both high VESYMP and high VEINF against B.1.1.7. Finally, using a separate intra-host mathematical model of viral kinetics, we demonstrate that a 0.6 log vaccine-mediated reduction in average peak viral load might be sufficient to achieve 50% VEINF, which suggests that human challenge studies with a relatively low number of infected participants could be employed to estimate all three vaccine efficacy metrics.

Evidence for antibody as a protective correlate for COVID-19 vaccines.

A correlate of protection (CoP) is urgently needed to expedite development of additional COVID-19 vaccines to meet unprecedented global demand. To assess whether antibody titers may reasonably predict efficacy and serve as the basis of a CoP, we evaluated the relationship between efficacy and in vitro neutralizing and binding antibodies of 7 vaccines for which sufficient data have been generated. Once calibrated to titers of human convalescent sera reported in each study, a robust correlation was seen between neutralizing titer and efficacy (ρ = 0.79) and binding antibody titer and efficacy (ρ = 0.93), despite geographically diverse study populations subject to different forces of infection and circulating variants, and use of different endpoints, assays, convalescent sera panels and manufacturing platforms. Together with evidence from natural history studies and animal models, these results support the use of post-immunization antibody titers as the basis for establishing a correlate of protection for COVID-19 vaccines.

A Deferred-Vaccination Design to Assess Durability of COVID-19 Vaccine Effect After the Placebo Group Is Vaccinated.

Multiple candidate vaccines to prevent COVID-19 have entered large-scale phase 3 placebo-controlled randomized clinical trials, and several have demonstrated substantial short-term efficacy. At some point after demonstration of substantial efficacy, placebo recipients should be offered the efficacious vaccine from their trial, which will occur before longer-term efficacy and safety are known. The absence of a placebo group could compromise assessment of longer-term vaccine effects. However, by continuing follow-up after vaccination of the placebo group, this study shows that placebo-controlled vaccine efficacy can be mathematically derived by assuming that the benefit of vaccination over time has the same profile for the original vaccine recipients and the original placebo recipients after their vaccination. Although this derivation provides less precise estimates than would be obtained by a standard trial where the placebo group remains unvaccinated, this proposed approach allows estimation of longer-term effect, including durability of vaccine efficacy and whether the vaccine eventually becomes harmful for some. Deferred vaccination, if done open-label, may lead to riskier behavior in the unblinded original vaccine group, confounding estimates of long-term vaccine efficacy. Hence, deferred vaccination via blinded crossover, where the vaccine group receives placebo and vice versa, would be the preferred way to assess vaccine durability and potential delayed harm. Deferred vaccination allows placebo recipients timely access to the vaccine when it would no longer be proper to maintain them on placebo, yet still allows important insights about immunologic and clinical effectiveness over time.

Clinical Endpoints for Evaluating Efficacy in COVID-19 Vaccine Trials.

Several vaccine candidates to protect against severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection or coronavirus disease 2019 (COVID-19) have entered or will soon enter large-scale, phase 3, placebo-controlled randomized clinical trials. To facilitate harmonized evaluation and comparison of the efficacy of these vaccines, a general set of clinical endpoints is proposed, along with considerations to guide the selection of the primary endpoints on the basis of clinical and statistical reasoning. The plausibility that vaccine protection against symptomatic COVID-19 could be accompanied by a shift toward more SARS-CoV-2 infections that are asymptomatic is highlighted, as well as the potential implications of such a shift.